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(54) Input processing method and Input control apparatus 



(57) An input processing meth_od_and input control 
apparat us that enable switching between n ormal opera- 
lion and hovering operation to be accomplished with a 
v ery simple operation in a n information processing 
apparatus that uses a toucfTinput device such as a tafr- 
J gXor the like as an input device. During a p eri od that an 
improved" hovering mode according to the present 
i nvention is set active,, the ti m e interval between a pen 
up_ motion and a subsequent pen down motion is 

detected. I f the time intgrval js ecu iaj tr> nr Innflflr than a 

Fig. 17 



predetermiped length of time, pen down information to 
be sent to the OS is set OFF, t hereb y effecting the hov- 
ering operation. On the other hand, if the time interval is 
shorter than the predetermined leng t h of time, the pen 
down inform ation to be__s ent to me OS is set ON, 
thereby effecting the normal operation . Thus, in the 
Improved hovering mocje. with an e xtra tap of a^en the 
immediately foll owing_p en operation wo rk s as if it were 
performed in no rmal mode^ 



PEN MOTION 



OFF- 
ON 



OPERATION MODE HOVERING OPERATION 



NORMAL OPERATION 



HOVERING OPERATION 



CM 
< 

CM 
IO 
O 

CO 

o> 
o 

CL 
LU 



Primed by Xerox (UK) Business Services 
2.16.7 (HRS)/3.6 



1 



1 EPO 996052 A2 2 

Description at the position of the touch. The figure shows the tablet 

10 and display 12 as a single integral unit. When the 
[0001 ] The present invention relates to a method for nen u is m oved whilst holding it touched to the, tablet 
processing jnput from a touch input rim/ic e such as a Jfl, as showjii aEiqure 2 of the accompanvinq drawinpjs. 
tahtet o r the like used as anjnpiiLdayice, and an input 5 3 |ine correspondinaJn its mov e ment is drawn on the 
control apparatus for implementing the method. display 12._ 

[0002] Portahla infnrm afl np processing aooara- [0007] In the case of a mouse, there is a mouse 
tuses. which are becoming popular, utiliz e touch input operation, called drag, in which the mouse is moved 
devices such as tablets or digitizers as input devices while keeping the mouse button pressed down; in a 
instead of mice. Generally, a tablet or digitizer is inte- w graphical input operation, a line is drawn when the 
grated with a display such as a liquid crystal display by mouse is dragged. On the other hand, when the mouse 
being mounted as a transparent plate over the display is moved without holding down a mouse button, the 
or placed underneath the display, and is configured to mouse cursor merely moves on the display. 
detect the posjtion of a s tyit^ pen orjhe like on the_cjjs- [0008] I n the case of a graphical input operatjpn by 
play when the st ylus pen or the like, as a pointing 75 a pen on a tablet, on the other hand, if a dot or line were 
device, contacts the display screen. alwa ys drawn with a_ pen down motion, an operation to 

[0003] Such input devices, generally called, touch move the cursor withcdjt-drawjna a dot or line, such as 
screens o r touch panels , have been implemented in var- the^Qperation^showp-in Figure 3 of the acco mpapyipg 
ious ways, including one that uses a resistive film (pres- d rawings, could not be accomplished . To avoid this, an 
sure sensitive tablet) consisting of transparen t 20 op eration mode is provided in which ev^n when the pen 
electrode s bonded to the surface of a display (CRT, is actually touched to the tajflet. the motion is not inter - 
LCD, plasma display, etc.) and performs aninout opera- preted as a pen down motion but the mouse cursor is 
tion by touch ing the sj^eg_with a f ir jger_pr a, pen, and merely caused to move . This mode is called a hovering 
one that performs an input operation on the screen with mode. To switch the operation between normal mode 
t he digitize r, mounted underneath the display, d etecti ng 25 and hovering mode, a normal mode selection button 16 
the_ POSition of the input by detectin g the ma gnetism and a hoverin g mode selection button 18 are provided 
being generated at the t ip of the pen (when the pen is outside the disp la y screen, as shown ifl figure, 4 of the 
touched to the screen, magnetism is generated, and the accompanying dra wings. |n an icon manipulation in the 
position of the input is detected by the electromagnetic hovering mode , , a p en fop .on_.an JfiQa_.only_resultsJa 
induction type digitizer mounted underneath the dis- 30 po sjtioning the cursor on that icon. 
play). In addition to such pressure se nsi tivQ tah IP* and [0009] In this way, an input operation on a touch 
electromag netic induction digitiz er methods, various input device such as a tablet or digitizer has required 
methods of input position detection have been consid- mode switching using the buttons provided outside the 
ered. such as an ultrasonic surface a coustic wave touch screen, and in the case of an input operation that 
paxxeLmethodthat uses ultrasonic waves. 35 requires frequent mode switching, the operation has 

[0004] AJablet, like a mouse, is also used to specify been very tiring and inefficient for an operator, 
a position in a graphical input operation, select a menu [0010] It is desirable to provide an input processing 
or activate a software program by manipulating an icon, method and input control apparatus for a touch input 
and so on. device that enables operation mode switching to be 

[0005] A mouse contains mouse buttons, and a 40 accomplished with a very simple operation, 
mouse operation to press and release a mouse button [001 1 ] According to an embodiment of a first aspect 
is called a mouse click, the mouse operation being clas- of the present invention, there is provided an input 
srfted as a single click, double click, etc. according to processing method for a device which provides input by 
how many times the button is pressed in succession. By performing a touch motion on an operating surface, 
putting the mouse cursor on a designated icon and 45 comprising: a first step of detecting the length of time of 

a non-touch state in which no touch motion is performed 
on the operating surface; and a second step of deter- 
mining information indicating a touch state in accord- 
ance with the detected length of time when a touch 
motion has occurred. 

[0012] According to an embodiment of a second 
aspect of the present invention, there is provided an 
input processing method for a device which provides 
input by performing a touch motion on an operating sur- 
face, comprising: a first step of detecting the number of 
successive occurrences of the touch motion; and a sec- 
ond step of determining information indicating a touch 
state in accordance with the detected number of occur- 



clicking the mouse on it, desired processing can be 
specif ied..i njhe case of a pen operation on a tablet. rf_ 
an operation tn tmirh the pen or t he like to the tablet 
(called a.pen down moti on) and thep |jft jt off the ta,fr|et_ 
* (called apen ip motion) is called a tap, then moving the so 
mouse cursor an d single-clickfoq or fJo^ ble^clicking the 
mouse corresponds to performing a single tap or double 
Jag on a designated icon. The pen do wn and pen up 
motions here embrace operations performed not only 
by a pen bu t also_by_a .f inaeL OLtheJika. 55 
[0006] In a graphic aljnpuLoperation. when a tablet 
I ftis touched with a pen 14 a&showru n Figure l^ol ihfl, 
accompanying drawings, a dot is drawn on a display 12 
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rences. 

[0013] According to an embodiment of a third 
aspect of the present invention, there is provided an 
input processing method for a device which provides 
input by performing a touch motion on an operating sur- 
face, comprising: a first step of detecting the number of 
occurrences of the touch motion over a predetermined 
length of time; and a second step of determining infor- 
mation indicating a touch state in accordance with the 
detected number of occurrences. 
[0014] According to an embodiment of a fourth 
aspect of the present invention, there is provided an 
input processing method for a device which provides 
input by performing a touch motion on an operating sur- 
face, comprising the steps of: detecting the number of 
successive occurrences of the touch motion; and deter- 
mining a corresponding mouse operation in accordance 
with the detected number of occurrences. 
[0015] Furthermore, embodiments of the present 
invention, can provide an input control apparatus for 
implementing the above method, and a program record- 
ing medium which is readable by a computer utilizing 
the input control apparatus, and on which is recorded a 
program for implementing the above method. 
[0016] Reference will now be made, by way of 
example, to the accompanying drawings, in which: 

Figure 1 , discussed hereinbefore, is a diagram for 
explaining the motion for drawing a dot with a pen; 
Figure 2, discussed hereinbefore, is a diagram for 
explaining the motion for drawing a line with a pen; 
Figure 3, discussed hereinbefore, is a diagram for 
explaining the motion for merely moving cursor 
coordinates without drawing a line; 
Figure 4, discussed hereinbefore, is a diagram for 
explaining mode switching buttons according to a 
previously-considered input device; 
Figure 5 is a perspective view of a portable informa- 
tion processing apparatus to which an embodiment 
of the present invention can be applied; 
Figures 6A and 6B are diagrams for use in explain- 
ing a pressure sensitive tablet and an electromag- 
netic induction tablet, respectively, as 
representative examples of tablets; 
Figure 7 is a diagram showing the details of a hot 
pad; 

Figure 8 is a block diagram showing the system 
configuration of the portable information processing 
apparatus shown in Figure 5; 
Figure 9 is a flowchart illustrating the sequence of 
processing performed by an exemplary tablet con- 
troller; 

Figure 10 is a diagram showing the possible format 
of data sent out from a tablet controller; 
Figure 1 1 is a diagram for use in explaining the pos- 
sible operation of a tablet controller; 
Figure 12 is a flowchart illustrating a pen driver 
processing sequence; 
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Figure 1 3 is a diagram for use in explaining the pos- 
sible operation of a pen driver; 
Figure 14 is a flowchart illustrating a processing 
sequence of an OS during graphical input process- 
5 ing; 

Figures 15A, 15B, and 15C are diagrams for use in 
explaining a method of operation mode switching 
for use in an embodiment of the present invention; 
Figures 16A, 16B, 16C. and 16D are diagrams for 
10 use in explaining a method of operation mode 
switching used in a previously-considered input 
device; - 

Figure 17 j S jnjtiaflrnm fnr ovp1aininr|-pAn nflnfjQn. 

and operation modes according to an embodiment 
is of the present invention; 

'Figure 18 is a diagram for explaining pen motion 
and operation modes according to a previously- 
considered input device; 

Figure 19 is a diagram showing an example of an 
20 icon manipulation screen; and 

Figures 20A and 20B are flowcharts illustrating a 
processing sequence of an OS during an icon 
manipulation. 

25 [0017] An embodiment of the present invention will 
be described below with reference to the accompanying 
drawings. The embodiment hereinafter described deals 
with an example that uses a pen (or stylus), but the 
invention is also applicable to devices that are operated 

30 using fingers. For example, ultrasonic surface acoustic 
wave touch panels and pressure sensitive tablets permit 
position input by touching them with a finger without 
using a pen. Embodiments of the present invention do 
not exclude application to such devices. 

35 [0018] Figure 5 is a perspective view of a portable 
information processing apparatus to which an embodi- 
ment of the present invention can be applied. A tablet 1 0 
and a liquid crystal display 12 are combined together 
with one overlaid on top of the other, and function as 

40 electronic "paper". Various types of tablet 10 are com- 
mercially implemented, and embodiments of the 
present invention are applicable to any type of tablet. 
[0019] Figures 6A and 6B are diagrams for explain- 
ing a pressure sensitive tablet and an electromagnetic 

45 induction tablet, respectively, as representative exam- 
ples of tablets. The pressure sensitive tablet 10 of Fig- 
ure 6A consists of a transparent film and glass, and is 
mounted over the liquid crystal display 12. When the 
film is brought into contact with the glass by being 

so pressed with a pen or the like, there occurs a change in 
the resistance value, based on which the position where 
the contact is made is detected. The electromagnetic 
induction tablet 10 of Figure 6B is constructed from a 
sensor plate containing a sensor coil, and is placed 

55 underneath the liquid crystal display 12. Pen position is 
determined by detecting the magnetism, generated 
from the tip of the pen, by means of the sensor coil. 
[0020] The details of a hot pad 20 in Figure 5 are 
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illustrated in Figure Z A h gyfi.rinfl ! ™ n °° " n fhQ pa? 

-gft is apjconjjgej^swjt ching operation between the 

^jlQimaljrK}de.aj^ 
ina to the present invention. When theJioveringJcojT22 
is touched during operation Ihlhefhormaj mode , the tab^, 
let 10 and display 12 operate in the improved hovering 

jBQde accordinaAo thepresentJnveDtiQn until this icon is 
touched again. 

[0021 ] Rgure 8 is a block diagram showing the sys- 
tem configuration of the portable information processing 
apparatus (the so-called pen computer) shown in Figure 
5. A muttichip module (MCM) 32, south bridge 38, and 
video graphics array (VGA) controller 36 are connected 
to a PCI (Peripheral Component Interconnect) bus 30. 
The south bridge 38, tablet controller 52, and ROM 
(read-only memory) 54 are connected to an ISA (Indus- 
try Standard Architecture) bus 50. 
[0022] The multichip module 32 contains multiple 
bare silicon chips mounted on a small printed board, 
and comprises a CPU, a north bridge, and a secondary 
cache memory. The north bridge is a PCI system con- 
troller for controlling data transfers between the CPU, 
main memory, secondary cache memory, PCI bus, etc. 
A synchronous DRAM (SDRAM) 34 as the main mem- 
ory is connected to the multichip module 32 via a mem- 
ory bus. The SDRAM 34 is characterized by its 
operation synchronized to the system bus clock. 
[0023] The VGA controller 36 controls the liquid 
crystal display 1 2 under the VGA standard. The south 
bridge 38 is a bridge, mounted with the PCI bus, that 
provides connections between the PCI bus and ISA bus 
on the motherboard, and controls data transfers 
between the CPU, memory, input/output devices, etc. A 
hard disk drive (HDD) 40 as an auxiliary storage device 
is connected to the south bridge 38. 
[0024] The tablet controller 52 is responsible for 
controlling the processing of input from the tablet 1 0 and 
detecting an operation performed on the hot pad 20, 
and includes a CPU 52a, a memory (RAM) 52b, and an 
interlace circuit 52c. The ROM 54 holds therein an initial 
program loader. 

[0025] A port replicator 60, also called an expan- 
sion I/O box, connector box, expansion unit, or the like, 
is an adaptor which is connected to a notebook compu- 
ter or a pen computer to enhance their expandability. 
Usually, it accommodates various connectors, such as a 
serial port 60d, a parallel port 60a, and a CRT connec- 
tor 60f, as well as connection ports for a keyboard 60b, 
a mouse 60c, a floppy disk drive 60e, an Ethernet port, 
etc. Connectors that are infrequently used when the 
notebook computer or pen computer is taken on the 
road are accommodated in the port replicator. 
[0026] In the present embodiment, the floppy disk 
drive 60e is connected via the port replicator 60, but the 
floppy disk drive may be connected directly to the pen 
computer, or alternatively, the pen computer itself may 
be constructed to contain a floppy disk. Further, the 
floppy disk drive may be incorporated in a docking sta- 



tion, rather than being connected via the port replicator. 
A docking station is a device that contains a SCSI card, 
an Ethernet card, a CD-ROM drive, a floppy disk drive, 
an additional PC card expansion bus, etc., and mostly is 
5 shaped so that a notebook computer can fit into it. 
[0027] Programs may be provided using the CD- 
ROM drive or the floppy disk drive accommodated in the 
docking station. 

[0028] Figure 9 is a flowchart illustrating the 

10 sequence of processing that the CPU 52a within the 
tablet controller 52 performs in accordance with the pro- 
gram loaded into the memory 52b of the controller 52. 
This program is usually stored on the HDD 40, and is 
loaded into the memory of the tablet controller 52 at 

is system power-up. The program may also be provided 
on other recording media such as a floppy disk or a CD- 
ROM. The illustrated process is invoked as an interrupt 
service routine when a pen down motion is performed 
on the tablet 10. 

20 [0029] First, in step 102, upon detecting the pen 
down motion ^ a pen down state nag ancf a peo_down 
state start flap are both set to 1 . an d a pen down state 
end flag is cleared to 0. The pen down stafe flag is a flag 
that is .set to i ndicate that the current state is the pen 

25 down state, and the pen down state start flag is a flag 
that is set to 1 only once when a transition is madej o 
t he pen down state, while the pen down state end flag is 
a flag th at is set to indicate the end of the pen dow n 
jstaJ&JT hese flags are implemented in the memory 52b 

30 within the tablet _c pntroller,52.-Next.in,step_104 J it is 
determined wh ether the current operation mode is the 
i mproved hoverin g mode or not , based on the operation 
performed on t he hovering jccji22-Qnihe.hot^ad_2a. If 
the current m ode is not the improved hovering mode. 

35 ffiaFjOiB^ 

ess procee dsJo„stecLlQ6^on.the-Othe Lhand. if the cur- 
rent mode is the inproved-rjov^rirjq- mode. the process 
proceeds-to~step40&- 

[0030] In step 106, an improved hovering mode 

40 flag, a flag that is set to indicate the improved hovering 
mode, is cleared to 0, i.e., set OFF. On the other hand, 
in step 108, the improved hovering mode flag is set to 1 , 
i.e., ON. The improved hovering mode flag also is imple- 
mented in the memory 52b within the tablet controller 

45 52. In step 110, which follows step 106 or 108, coordi- 
nate data indicating the position at which the tablet 1 0 is 
pressed by the pen is detected. In the case of a pres- 
sure sensitive tablet, the coordinate data is detected by 
applying a voltage and measuring the resistance. 

so [0031] Next, in step 1 12, transmission data consist- 
ing of status (1 byte) and coordinate data (4 bytes), as 
shown in Figure 10, is assembled in the memory 52b 
within the tablet controller 52, and is sent to the pen 
driver described later. The status byte contains a pen 

55 down state bit (pen down information), a pen down state 
start bit, a pen down state end bit, and an improved hov- 
ering mode bit, respectively indicating the values of the 
pen down state flag, pen down state start flag, pen 
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down state end flag, and improved hovering mode flag. 
[0032] Jn step 1 1 4. it isxLeJ tejt minnri wh e th er th e cur* 
.t aatstateJs the pen up sfate..and if the-state-isjaot the 
penup state. thati's. Xthe state is still the pen down 
state, the process proceeds to step 1 16; on the other s 
_ hand if tha stata is tha pan up state, {he process pro - 
cee ds to step 11 8. In step 1 1 6, the pen down state start 
"flagj s cleared to 0, and the process loops back to step 
~Tf QTIn st ep _lj 8, on.the.otheihaflcjjte 
flag and the pen down state start flag are both cleared 10 
to 0, while settin g the pen down state end flag to 1, and 
the status reflecting the contents of t heseJI ags is cre- 
ated and sent out. In this w ay, during tha Q efl flfl from the 
' pen down to the pen up , da ta is sent out at predeter- 
mined intervals of time (for exa mpl e, every 5 ms ). is 
[0033] The state transitions of the flags in the 
improved hovering mode in the above-described proc- 
ess will be described with reference t o Figure 1 1 . F irst, 
when the pen down motion is detected, the pen down 
state flag is set to 1 , the pen down state start flag is set 20 
to 1 , the pen down state end flag is cleared to 0, and the 
improved hovering mode flag is set to 1 in steps 102, 
104, and 108, as shown in case (A) in Figure 1 1 . Then, 
these flag states are written in the status bits and sent 
out in step 112 together with the coordinate data 25 
detected in step 110. 

[0034] As long as the pen down state continues, the 
process consisting of steps 114, 116, 110, and 112 is 
carried out in a loop fashion, as shown in case (B) in 
Figure 1 1 ; during that period, the pen down state flag 30 
remains at 1 , the pen down state start flag remains at 0, 
and the pen down state end flag remains at 0. During 
the loop process, the coordinate data is constantly 
updated in step 110, and the coordinate data and the 
status are sent out in step 1 12 at predetermined inter- 35 
vals of time. 

[0035] When a pen up motion is detected to end the 
pen down state, the process proceeds from step 1 14 to 
step 118, and the pen down state flag and pen down 
state start flag are now at 0 and the pen down state end 40 
flag is set to 1 , as shown in case (C) in Figure 1 1 . This 
forms the final status to be sent out. In the above proc- 
ess Jfj^eji^mcl^ 

the pen down motion^j hejlaqs make tran sitions frpm 
the states sho wn.in case (A) i n Figure 1 ^directly to the as 
states shown in case. (C) in Figure 1 1 without passing 
■through the states shown in case (B) in Figure 1 1 . 
[0036] Figure 12 is a flowchart illustrating a, pen 
Hr jyar pmroc^nq sequence carried out by the CPU 32a 
within the multichip module 32. This pen driver pro gram so 
Jsj^aHystCi^ 

. SDRAM 34 -aLsvstem.power-up and_executed_QrLthe 
SDRAM 34 . The^program„mav_bej3fovided,on other- 
storage media such as a floppy disk or a CD-ROM. The 
lllu^aj^i^essjsjnitiated.^ 55 
oldafo senLlmm tha tahlat rr>ntr ff ||ar fjtfc First, in step 
202, the data (see Figure 10) sent from the tablet con- 
troller 52 is rec ived, and stored in a designated area 



within the SDRAM 34. Next, in step 204, the status in 
the received data is examined to determine whether the 
improved hovering mode bit is 1 or 0, and if the 
improved hovering mode bit is 1 , the process proceeds 
to step 206; on the other hand, if the improved hovering 
mode bit is 0, the process proceeds to step 224. 
[0037] In step 206, it is determined whether the pen 
down state end bit contained in the status byte in the 
received data is 1 or 0, and if the pen down state end bit 
is 1. the process proceeds to step 208; on the other 
hand, if the pen down state end bit is 0, the process pro- 
ceeds to step 210. In step 208, the countdown timer is 
set and started, whereupon the routine is terminated. 
This countdown timer is provided to measure the time 
interval between a pen up motion and a pen down 
motion, thereby to determine whether or not the length 
of time of the pen up state is less than a predetermined 
threshold value. This timer is implemented as a soft- 
ware timer in the SDRAM 34. 
[0038] In step 21 0, it is determined whether the pen 
down state start bit contained in the status is 1 or 0, and 
it the pen down state start bit is 1 , the process proceeds 
to step 212; on the other hand, if the pen down state 
start bit is 0, the process proceeds to step 220. In step 
212, the countdown timer is checked to determine 
whether the timer has counted down 0 or not, and if the 
timer has not yet counted down to 0, that is, if the length 
of time of the pen up state is shorter than the predeter- 
mined length of time, the process proceeds to step 214; 
on the other hand, if the timer has already counted 
down to 0, that is, if the length of time of the pen up state 
is longer than the predetermined length of time, the 
process proceeds to step 218. 
[0039] In step 214, hovering valid flag is set to 1, 
and the process proceeds to step 216. This hovering 
valid flag is a flag that is set to indicate that the hovering 
operation is to be performed validly in the improved hov- 
ering mode as it is originally intended. The flag is imple- 
mented in the SDRAM 34. In step 216. the pen down 
state bit in the status is changed to 0, and the process 
proceeds to step 224. On the other hand, in step 218, 
the hovering valid flag is cleared to 0 to invalidate the 
hovering operation in the improved hovering mode as 
an exception and thereby to effect the normal mode; 
then, the process proceeds to step 224. 
[0040] In step 220, which is carried out when the 
pen down state start bit is detected as being 0 in step 
210, the hovering valid flag is checked to determine 
whether it is at 1 or 0, and if the hovering valid flag is at 
1 , the process proceeds to step 222; on the other hand, 
if the hovering valid flag is at 0, the process proceeds to 
step 224. In step 222, the pen down state bit in the sta- 
tus is changed to 0, and the process proceeds to step 
224. In the final step 224, the coordinate data and the 
status containing the pen down state bit after comple- 
tion of the above processing are sent to the operating 
system (OS). 

[0041] As the result of th above pen driver 
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processing, the pen down state bit (pen down informa- 
tion) in the status reported to the OS along with the 
coordinate data is as follows. When the mode is not the 
improved hovering mode, that is, when the mode is the 
normal mode, steps 202, 204, and 224 are carried out in 
seque nce, so that the pen down state bit remains^ 
uncTianged at 1 and is reported as is. 
[0042] Pen driver operation in the i mproved hover- 
ing rrifflte on t he other harKj._wjlLba_d escribed below 
with referen t tn Fignffl, ia. In tfrffi improve^ Covering 
mode, the operation differs depending on th a fim 9 J ifl[flr- 
yaL between the pen up motion and the pep flown 
nr ^on detected in the above process, that is. depend - 
in g on whet her-o uiot the length of time of the pen up 
state is less than the threshold value set by the count- 
down timer. 

[0043] First, since the pen down state end bit is 1 in 
the final status, that is, the status received when the pen 
down state has ended by detectinp a pen up motion , the 
steps 202, 204, 206, and 208 are carried out, as shown 
in case (A) in Figure 13, and the nnnmrinwn timej is thus 
s et and started to count the time until the next pen down 
motion i s detected. 

[0044] Then, when the next pen down occurs with 
the countdown timer already reaching 0, that is, when a 
pen down motion is detected after the predetermined 
time has elapsed from the preceding pen up motion, the 
first status received indicates that the pen down state bit 
is 1 , the pen down state start bit is 1 , and the pen down 
state end bit is 0, as shown in case (B) in Figure 13, and 
at this time, the countdown timer is already at 0; accord- 
ingly, the steps 202, 204, 206, 210. 212, 214, 216, and 
224 are carried out in sequence. In the process, the 
hovering valid flag is set to 1 in step 214. The pen down 
state bit is changed to 0 in step 216, and the change 
state bit is reported to the OS in step 224. In other 
words, the number of pen down motions performed 
within the predetermined time is detected using the 
countdown timer, and if it is determined in step 212 that 
the countdown timer reads 0, that means that the 
number of pen down motions (touch motions) occurring 
in succession within the predetermined time is 1; as a 
result, the pen down state bit is not set ON, and it is 
determined that the state is not the pen down state. 
[0045] In intermediate status received during the 
pen down state following the states shown in case (B) in 
Figure 13, the pen down state bit is 1, the pen down 
state start bit is 0, and the pen down end bit is 0, as 
shown in case (C) in Figure 1 3 and, at this time, the hov- 
ering valid flag is at 1 ; accordingly, the steps 202, 204, 
206, 210, 220, 222, and 224 are carried out in 
sequence. Here again, the pen down state bit is 
changed to 0 in step 222, and the changed state bit is 
reported to the OS in step 224. 
[0046] On the other hand, when the next pen down 
occurs with the countdown timer yet to reach 0, that is, 
when a pen down motion is detected befor the prede- 
termined time has elapsed from the preceding pen up 



10 



15 



25 



30 



35 



40 



55 



motion, the first status received indicates that th pen 
down state bit is 1 , the pen down state start bit is 1 , and 
the pen down state end bit is 0, as shown in case (D) in 
Figure 13, and at this time, the countdown timer has not 
yet reached 0; accordingly, the steps 202, 204, 206, 
210, 212, 218, and 224 are carried out in sequence. In 
the process, the hovering valid flag is cleared to 0 in 
step 218. The pen down sjffl e hit rema ins unchanged at 
1 and is reported to the OS as it is. In other words, the 
number of pen down motion? performed withjn the nffi- 
determiner! time k ^ete^ ifif J nfiinp the mimtriown timer. 
and if it is determined in step 212 that the countdown 
timer has not vet reached 0, that means that the number 
of pen down motions ( t ouch motions ) oc currin g in suc- 
cession within the predetermined time is 2 or more: as a 
result, the p^n J nwn **** * bit is set ON accordingly, an d 
it is determined that the state is the pen dowp state. 
[0047] In intermediate status received during the 
pen down state following the states shown in case (D) in 
Figure 1&.the pen down state bit is 1. the pen down 
state start bit is 0 , and the pen down state end bit is 0, 
as shown in case (E) in Figure 13, and at this time , the 
hovering valid flag is at 0; accordingly, the steps 202, 
2 04, 206, 210, 2 20,_ angl_224_ar.e_ carried out in 
s equence . As a result, the pen down state bit remains 
unchanged at 1 , and is reported to the OS as it is. 
[0048] Following the states shown in case (B), (C), 
(D), or (E) in Figure 1 3. when the pep flow n jftatq s , ends 
by detecting a pen up motion, and the final status is 
received, the countdo wn timer i s started, as previously 
d escribed, to prepare for the next pen down, as shown 

jncjse4A)j£EgureJl3 

[0049] Figure 14 is a flowchart illustrating the 
processing sequence of the OS during graphical input 
processing. This OS program is usually stored on the 
HDD 40, and is loaded into the SDRAM 34 at system 
power-up and executed on the SDRAM 34 by the CPU 
32a within the multichip module 32. This OS program 
may be provided on other storage media such as a 
floppy disk or a CD-ROM. The illustrated process is ini- 
tiated upon arrival of the data sent from the pen driver. 
First, in step 302, the data sent from the pen driver is 
received, and stored in a designated area within the 
SDRAM 34. Next, in step 304, it is determined whether 
the pen down state bit in the status is 1 or 0, and if the 
pen down state bit is 1 , the process proceeds to step 
306; on the other hand, if the pen down state bit is 0, the 
process proceeds to step 308. 
[0050] In step 306, the cursor is moved while main- 
taining the pen down state which is equivalent to the 
state in which a mouse is clicked and held down. This 
causes a dot or line to be drawn, just as if a mouse was 
dragged. On the other hand, in step 308, the cursor is 
merely moved to the position indicated by the received 
coordinate data. 

[0051] According to the above-described tablet 
controller, pen driver, and OS processing operations, by 
just performing an extra pen tap in the improved hover- 
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ing mode, the immediately following pen tap works just 
like a pen tap performed in the normal mode. That is, 
supposing that the state shown in Figure 15A is a state 
in the improved hovering mode, if a line drawing motion 
is performed on the tablet after performing a pen tap 5 
once, as shown in Figure 15B, a line is drawn on the dis- 
play as in the normal mode, as shown in Figure 15C. 
After a series of drawing motions, a pen up state is 
entered, and after the elapse of a certain amount of 
time, the hovering operation is again enabled. Using the 10 
previously-considered input device, the pen had to be 
moved outside the screen to switch the mode, as shown 
in Figures 1 fi^, ifiB ifiP, and ifin but using an 
embodiment of the present invention, a smooth opera- 
tion becomes possible. 75 
[0052] Pan motion anr| nprmtinn mnrlrr willJn. 
descr ibed in more d et ail when a line i s drawn by tempo- 
rarily enterin g the normal operation mode during the 
improved hovering mofle and then resuming the hover - 
ing operation . I n an embodiment of the present inven - 20 
tion, immediately before drawing , a line, a p,en tap is 
performed to switch the operation, and immediately 
after that, a line is drawp; wrjen the pen is |jfteo; off the 
table! after drawing thejine, the hovering operation 
automatically resumes, as s hown in^EiguiaJi In the 25 
previously-considered method, on the other hand, at 
timing^ before dra wings JineJth e^appropriate button 
had to be pressed to switch to the normal mode, as 
shown in Fiaure 18. and then at-ib-nigg B after drawing 
the line, another button had to be pressed to switch 30 
back to the hovering mode . An embodiment of the 
present inve^j ^ojucan^elir ninate the heed fo r suchjrou- 
blesome buttonoperations. 

[0053] Next, a description will be given of JcQa 
manipulations in the improved hovering mode according 35 
to an embodiment of the present invention. Suppose an_ 
j con manipulation screen such as shown in Eiaure 19 is 
used in the improved hovering mode. In this case also, 
by just performing an extra pen tap, the immediately fol- 
lowing pen tap works just like a pen tap performed in the 40 
nflrrpai mod e. More s pecificall y, since the fi rst tap is 
used for operation switching, the equivalent of a s jfj ple 
cljck of a mouse is accom plished bv a double tap of the 
pqp. and the equivalent of a double click of a mouse is 
accomplished by a trig| a-fofrpf thfUafiflL 45 
[0054] Figures 20A and 20B a re flowcharts illustrat- 
ing the processing sequence of the OS during an icon 
manipulation. This OS program is usually stored on the 
HDD 40, and is loaded into the SDRAM 34 at system 
power-up and executed on the SDRAM 34 by the CPU so 
32a within the multichip module 32. This OS program 
may be provided on other storage media such as a 
floppy disk or a CD-ROM. The illustrated process is ini- 
tiated upon arrival of the data sent from the pen driver. 
As earlier described, for succe ssively, oor.urrino p^p 55 



th e first mouse clic k. 

-m — — — , 

[0055] First, in step 402, the data sent from the pen 
driver is received, and stored in a designated area 
within the SDRAM 34. Next, in step 404, it is determined 
whether the pen down state bit and pen down state start 
bit in the status are both 1 or not, and if the result is 
YES, the process proceeds to step 406; on the other 
hand, if the result is NO, the routine is terminated. 
[0056] In step 406, it is determined whether an 
jgjerruptlimer value, which will be set in the following 



step 408, is 0 or not.^ n dHfiftirb'mer value is 0. the proc - 
ess proc eeds to step 408; on the other hand, if theJimer 
'value is not 0. the process proceeds to step 410. In step' 
408, the interrupt tin i er is set, and the routine is termi- j 
nated. In step 410, on the other hand, it is decided tha t; 
the next pen down has occurred within the predeter- 
mined time from the previous nen down and the, infer-'' 
rupt timer is reset In the next step 412. it is de termined 



taps, the pen driver sets the p e p down staje bit to 1 for 
the second and later taps, and sends this bit state to the 
OJ>. Accordingly, the OS interprets the geco nri ^n w ag _ 



. ttiat a double click has occurred . I 
[0057] When an interrupt is caused by the interrupt 
timer setln step 408."the processlrh^ 'H ftg iirp ?QrT 
is carried out. Since this process is invoked when the 
next pen down did qgf occur within the predetermined 
time from the previous pen down, it is determined i n 
Step 450 tha t a sing^ djr u ^ ^TrtTl 
[0058] When a singje^lick is detected, a file selec- 

jion or other operation is porfprmoH and when a double 
d j ck^js det ecte d, a program in the file is activated, for 

'example. 

~10059] Asdescribed above, according to an embod- 
iment of the present invention, in an information 
processing apparatus that uses a jouch input device 
such as atableLo r digitize r instead of a mouse as an 
input device, switching between normal operation and 
hovering operation can be accomplished with a very 
simple operation, enhancing its usability. Though the 
embodiment has been described by dealing with an 
example that uses a pen ( or stylus) , an embodiment of 
the present invention is also applicable to an apparatus 
that is operated by a finger. 

[0060] The invention may be embodied in other 
specific forms without departing from the spirit or essen- 
tial characteristics thereof. The present embodiment is 
therefore to be considered in all respects as illustrative 
and not restrictive, the scope of the invention being indi- 
cated by the appended claims rather than by the forego- 
ing description and all changes which come within the 
meaning and range of equivalency of the claims are 
therefore intended to be embraced therein. 
[0061] It will be appreciated that computer pro- 
grams can be stored on a variety of media, such as 
floppy disks, hard disks, CD-ROMs, etc., or downloaded 
into a computer, for example from the Internet. It is 
intended that the attached claims should encompass 
computer programs in all these, and similar, forms. 
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Claims 

1 . An input processing method for a device which pro- 
vides input by performing a touch motion on an 
operating surface, comprising: 

a first step of detecting the length of time of a 
non-touch state in which no touch motion is 
performed on said operating surface; and 
a second step of determining information indi- 
cating a touch state in accordance with said 
detected length of time when a touch motion 
has occurred. 

2. An input processing method as claimed in claim 1 , 
wherein when a touch state occurs, said first step 
detects the length of time of said non-touch state 
that follows said touch state. 

3. An input processing method as claimed in claim 1 , 
wherein said second step determines that the state 
is the touch state if said detected length of time is 
less than a predetermined length of time. 

4. An input processing method for a device which pro- 
vides input by performing a touch motion on an 
operating surface, comprising: 

a first step of detecting the number of succes- 
sive occurrences of said touch motion; and 
a second step of determining information indi- 
cating a touch state in accordance with said 
detected number of occurrences. 

5. An input processing method as claimed in claim 4, 
wherein said first step detects the number of occur- 
rences of said touch motion over a predetermined 
length of time. 

6. An input processing method for a device which pro- 
vides input by performing a touch motion on an 
operating surface, comprising: 



8. An input processing method as claimed in any one 
of claims 4 to 6, wherein when said detected 
number of occurrences is 2, it is determined that a 
single click has occurred, and/or when said 

5 detected number of occurrences is 3, it is deter- 
mined that a double click has occurred. 

9. An input processing method as claimed in any one 
of claims 1 to 7, wherein 

10 

said device is a device that displays a cursor in 
a display section, 

said cursor has a first state for directing the 
processing of a manipulation target displayed 
15 in said display section, and a second state for 

not directing the processing of said manipula- 
tion target, and 

there is included a step in which said cursor 
changes from said second state to said first 
20 state in response to said touch state indicating 

information. 

10. An input processing method as claimed in any one 
of claims 1 to 9, including the step of determining 

25 information indicating the termination of said touch 
state after said second step has determined said 
touch state indicating information and said touch 
state has ended. 

30 1 1. An input processing method as claimed in any one 
of claims 1 to 7, wherein 

said device is a device that displays a cursor in 
a display section, 
35 said cursor has a first state for directing the 

processing of a manipulation target displayed 
in said display section, and a second state for 
not directing the processing of said manipula- 
tion target, and 

40 there is included a step in which said cursor 

changes from said first state to said second 
state when said touch motion has ended. 



15 



40 



a first step of detecting the number of occur- 
rences of said touch motion over a predeter- 45 
mined length of time; and 
a second step of determining information indi- 
cating a touch state in accordance with said 
detected number of occurrences. 

50 

7. An input processing method as claimed in any one 
of claims 4 to 6, wherein when said number of 
occurrences is 1 , said second step determines that 
the state is not the touch state occurring in relation 
to said touch motion, and when said detected ss 
number of occurrences is 2 or more, then deter- 
mines that the state is the touch state. 



12. An input processing method as claimed in any one 
of claims 1 to 11 , including the step of performing 
information processing in response to said touch 
state indicating information. 

13. An input processing method as claimed in any one 
of claims 1 to 4, wherein said touch motion is per- 
formed using a pen on said operating surface, and 

said non-touch state is a pen up state, and/or 
said touch state is a pen down state. 

14. An input processing method as claimed in claim 9, 
wherein said first state is a cursor-clicked state, 
and/or said second stat is a hovering state. 
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1 5. An input processing method for a device which pro- 
vides input by performing a touch motion on an 
operating surface, comprising the steps of: 

detecting the number of successive occur- 
rences of said touch motion; and 
determining a corresponding mouse operation 
in accordance with said detected number of 
occurrences. 

16. An input processing method as claimed in claim 15, 
wherein said corresponding mouse operation 
determining step determines that a single click has 
occurred when said detected number of occur- 
rences is 2, and/or determines that a double click 
has occurred when said detected number of occur- 
rences is 3. 

17. An input processing method as claimed in any one 
of claims 1 to 16, wherein said device comprises a 
display section and said touch motion operating 
surface is arranged in said display section. 

18. An input processing method as claimed in any one 
of claims 1 to 16, wherein each of said steps is car- 
ried out only when a designated mode is set active. 

19. An input control apparatus for a touch input device 
which provides input by performing a touch motion 
on an operating surface, comprising: 

a first unit detecting the length of time of a non- 
touch state in which no touch motion is per- 
formed on said operating surface; and 
a second unit determining information indicat- 
ing a touch state in accordance with said 
detected length of time when a touch motion 
has occurred. 

20. An input control apparatus as claimed in claim 19, 
wherein when a touch state occurs, said first step 
detects the length of time of said non-touch state 
that follows said touch state. 

21. An input control apparatus as claimed in claim 19, 
wherein said second unit determines that the state 
is the touch state if said detected length of time is 
less than a predetermined length of time 

22. An input control apparatus for a device which pro- 
vides input by performing a touch motion on an 
operating surface, comprising: 

a first unit detecting the number of successive 
occurrences of said touch motion; and 
a second unit determining information indicat- 
ing a touch state in accordance with said 
detected number of occurrences. 



23. An input control apparatus as claimed in claim 22, 
wherein said first unit detects the number of occur- 
rences of said touch motion over a predetermined 
length of time. 

5 

24. An input control apparatus for a device which pro- 
vides input by performing a touch motion on an 
operating surface, comprising: 

10 a first unit detecting the number of occurrences 

of said touch motion over a predetermined 
length of time; and 

a second unit determining information indicat- 
ing a touch state in accordance with said 
15 detected number of occurrences. 

25. An input control apparatus as claimed in any one of 
claims 22 to 24, wherein when said number of 
occurrences is 1 , said second unit determines that 

20 the state is not the touch state occurring in relation 
to said touch motion, and when said detected 
number of occurrences is 2 or more, then deter- 
mines that the state is the touch state. 

25 26. An input control apparatus as claimed in any one of 
claims 22 to 25, wherein when said detected 
number of occurrences is 2, it is determined that a 
single click has occurred, and/or when said 
detected number of occurrences is 3, it is deter- 

30 mined that a double click has occurred. 

27. An input control apparatus as claimed in any one of 
claims 1 9 to 25, wherein 

35 said device is a device that displays a cursor in 

a display section, 

said cursor has a first state for directing the 
processing of a manipulation target displayed 
in said display section, and a second state for 
40 not directing the processing of said manipula- 

tion target, and 

there is included a unit for changing said cursor 
from said second state to said first state in 
response to said touch state indicating informa- 
45 tion. 

28. An input control apparatus as claimed in any one of 
claims 19 to 27, including a unit determining infor- 
mation indicating the termination of said touch state 

so after said second unit has determined said touch 
state indicating information and said touch state 
has ended. 

29. An input control apparatus as claimed in any one of 
55 claims 19 to 25, wherein 

said device is a device that displays a cursor in 
a display section, 
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said cursor has a first state for directing the 
processing of a manipulation target displayed 
in said display section, and a second state for 
not directing the processing of said manipula- 
tion target, and 

there is included a unit changing said cursor 
from said first state to said second state when 
said touch motion has ended. 

30. An input control apparatus as claimed in any one of 
claims 19 to 29, including a unit performing informa- 
tion processing in response to said touch state indi- 
cating information. 

31 . An input control apparatus as claimed in any one of 
claims 19 to 22. wherein said touch motion is per- 
formed using a pen on said operating surface, and 

said non-touch state is a pen up state, and/or 
said touch state is a pen down state. 

32. An input control apparatus as claimed in claim 27, 
wherein said first state is a cursor-clicked state, 
and/or said second state is a hovering state. 

33. An input control apparatus for a device which pro- 
vides input by performing a touch motion on an 
operating surface, comprising: 

a unit detecting the number of successive 
occurrences of said touch motion; and 
a unit determining a corresponding mouse 
operation in accordance with said detected 
number of occurrences. 

34. An input control apparatus as claimed in claim 33, 
wherein said corresponding mouse operation 
determining unit determines that a single click has 
occurred when said detected number of occur- 
rences is 2, and/or determines that a double click 
has occurred when said detected number of occur- 
rences is 3. 

35. An input control apparatus as claimed in anyone of 
claims 1 9 to 33, wherein each of said units operates 
only when a designated mode is set active. 

36. An information processing apparatus comprising: 
said touch input device; and an input control appa- 
ratus as claimed in any one of claims 19 to 34. 

37. An information processing apparatus comprising: 
said touch input device; a display device; and an 
input control apparatus as claimed in any one of 
claims 19 to 34, and wherein: the operating surface 
of said touch input device is arranged in said dis- 
play device. 



38. A recording medium readable by a computer, said 
computer using a device which provides input by 
performing a touch motion on an operating surface, 
said recording medium having a program recorded 
5 thereon for causing said computer to implement: 

a first function detecting the length of time of a 
non-touch state in which no touch motion is 
performed on said operating surface; and 
w a second function determining information indi- 

cating a touch state in accordance with said 
detected length of time when a touch motion 
has occurred. 

15 39. A recording medium as claimed in claim 38, 
wherein when a touch state occurs, said first func- 
tion detects the length of time of said non-touch 
state that follows said touch state. 

20 40. A recording medium as claimed in claim 38, 
wherein said second function determines that the 
state is the touch state if said detected length of 
time is less than a predetermined length of time. 

25 41. A recording medium readable by a computer, said 
computer using a device which provides input by 
performing a touch motion on an operating surface, 
said recording medium having a program recorded 
thereon for causing said computer to implement: 

30 

a first function detecting the number of succes- 
sive occurrences of said touch motion; and 
a second function for determining information 
indicating a touch state in accordance with said 
35 detected number of occurrences. 

42. A recording medium as claimed in claim 41, 
wherein said first function detects the number of 
occurrences of said touch motion over a predeter- 

40 mined length of time. 

43. A recording medium readable by a computer, said 
computer using a device which provides input by 
performing a touch motion oh an operating surface, 

45 said recording medium having a program recorded 
thereon for causing said computer to implement: 

a first function detecting the number of occur- 
rences of said touch motion over a predeter- 
so mined length of time; and 

a second function determining information indi- 
cating a touch state in accordance with said 
detected number of occurrences. 

55 44. A recording medium as claimed in any one of 
claims 41 to 43, wherein when said number of 
occurrences is 1 , said second function determines 
that the state is not the touch state occurring in rela- 
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tion to said touch motion, and when said detected 
number of occurrences is 2 or more, then deter- 
mines that the stat is the touch state. 

45. A recording medium as claimed in any one of s 
claims 41 to 44, including a function for causing 
said computer to determine that a single click has 
occurred when said detected number of occur- 
rences is 2, and/or a function for causing said com- 
puter to determine that a double click has occurred io 
when said detected number of occurrences is 3. 

46. A recording medium as claimed in any one of 
claims 38 to 44, wherein 

15 

said device is a device that displays a cursor in 
a display section, said cursor having a first 
state for directing the processing of a manipu- 
lation target displayed in said display section, 
and a second state for not directing the 20 
processing of said manipulation target, and 
there is included a function changing said cur- 
sor from said second state to said first state in 
response to said touch state indicating informa- 
tion. 25 

47. A recording medium as claimed in any one of 
claims 38 to 46, including a function for determining 
information indicating the termination of said touch 
state after said second function has determined 30 
said touch state indicating information and said 
touch state has ended. 

48. A recording medium as claimed in any one of 
claims 38 to 44. wherein 35 

said device is a device that displays a cursor in 
a display section, 

said cursor has a first state for directing the 
processing of a manipulation target displayed 40 
in said display section, and a second state for 
not directing the processing of said manipula- 
tion target, and 

there is included a function for changing said 
cursor from said first state to said second state 45 
when said touch motion has ended. 

49. A recording medium as claimed in any one of 
claims 38 to 48, including a function for performing 
information processing in response to said touch so 
state indicating information. 

50. A recording medium as claimed in any one of 
claims 38 to 41, wherein said touch motion is per- 
formed using a pen on said operating surface, and 55 

said non-touch state is a pen up state, and/or 
said touch state is a pen down state. 



51. A recording medium as claimed in claim 46, 
wherein said first state is a cursor-clicked state, 
and/or said second state is a hovering state. 

52. A recording medium readable by a computer, said 
computer using a device which provides input by 
performing a touch motion on an operating surface, 
said recording medium having a program recorded 
thereon for causing said computer to implement: 

a function detecting the number of successive 
occurrences of said touch motion; and 
a function determining a corresponding mouse 
operation in accordance with said detected 
number of occurrences. 

53. A recording medium as claimed in claim 52, 
wherein said corresponding mouse operation 
determining function determines that a single click 
has occurred when said detected number of occur- 
rences is 2, and/or determines that a double click 
has occurred when said detected number of occur- 
rences is 3. 

54. A recording medium as claimed in any one of 
claims 38 to 53, wherein said device comprises a 
display section and said touch motion operating 
surface is arranged in said display section. 

55. A computer program which, when running on a 
computer, is operable to carry out the steps of a 
method as claimed in any one of claims 1 to 18. 
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